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TITLE OF THE INVENTION 
DIGITAL WATERMARK DETECTION METHOD AND APPARATUS 
CROSS-REFERENCE TO RELATED APPLICATIONS 
This application is based upon and claims the 
5 benefit of priority from the prior Japanese Patent 

Application No. 2002-218404, filed July 26, 2002, the 
entire contents of which are incorporated herein by 
reference . 

BACKGROUND OF THE INVENTION 

10 1. Field of the Invention 

The present invention relates to a digital 
watermark detection method and apparatus useful in 
preventing illegal copies of a digital video signal 
provided via, for example, a recording medium. 

15 2. Description of the Related Art 

As apparatuses for recording and playing back 
digital image data, such as a digital VTR, DVD (Digital 
Versatile Disk) , and the like have prevailed, the 
number of digital moving images that can be played back 

20 by these apparatuses are provided. Various digital 

moving images are distributed via digital television 
broadcast via the Internet, broadcast satellite, 
communication satellite, and the like, enabling users 
to enjoy high-quality digital moving images. 

25 It is easy to form high-quality copies from 

digital moving images on the digital signal level. 
Therefore, if some copy protection or copy control is 



- 2 - 



not applied to digital moving images, there is the 
danger of unrestricted formation of copies of digital 
images. Therefore, illicit copies of digital images 
must be prevented, and the number of generations of 
5 copies formed by authorized users must be restricted. 

For this purpose, a method of appending information 
for copy control to each digital moving image, and 
preventing illicit copies or restricting copies has 
been proposed. 

10 As a technique for superposing additional 

information to a digital moving image in such a way, 
digital watermarking is known. In digital 
watermarking, information such as identification 
information of the copyright owner or user of contents, 

15 right information of the copyright owner, use 

conditions of contents, secret information required 
upon using contents, the aforementioned copy control 
information, or the like (such information will be 
referred to as watermark information hereinafter) is 

2 0 embedded in contents of audio data, music data, moving 

image data, still image data, or the like, which has 
been converted into digital data, so as not to be easy 
to perceive. By detecting the embedded watermark 
information from the contents later as needed, 

25 copyright protection, including use control and copy 

control, can be achieved, and further use of the 
contents is possible. 



As a conventional method of digital watermarking, 
a method that applies a spread spectrum technique is 
known. In this method, watermark information is 
embedded in a digital moving image in the following 
sequence . 

In step El, an image signal undergoes spread 
spectrum by being multiplied by a PN (Pseudorandom 
Noise) sequence. 

In step E2, the image signal after spread spectrum 
undergoes frequency transformation (e.g., DCT 
transformation) . 

In step E3, watermark information is embedded in 
the image signal by changing the values of specific 
frequency components . 

In step E4, the image signal undergoes inverse 
frequency transformation (e.g., IDCT transformation). 

In step E5, the image signal undergoes inversely 
spread spectrum (the image signal is multiplied by the 
same PN sequence as in step El) . 

Watermark information is detected in the following 
sequence, from the digital moving image, in which the 
watermark information has been embedded in the above 
sequence . 

In step Dl, the image signal undergoes spread 
spectrum by being multiplied by a PN (Pseudorandom 
Noise) sequence (the same PN sequence as in step El) . 

In step D2, the image signal after spread spectrum 
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information can be detected even if the input image 
signal is under an attack of scaling. 

According to another aspect of the invention, to 
detect watermark information embedded in an input image 
5 signal, firstly, the auto-correlation function of the 

input image signal is computed. The auto-correlation 
function is filtered to generate a specific frequency 
component signal. From this specific frequency 
component signal, the watermark information is 
10 detected. Before the auto-correlation function is 

computed, image rotation may be performed on the input 
image signal. 

According to a further aspect of the invention, to 
detect watermark information embedded in an input image 

15 signal, firstly, the auto-correlation function of the 

input image signal is computed. The auto-correlation 
function is accumulated for a first period of time, 
thereby generating a first accumulation signal. A 
specific frequency component signal is extracted from 

20 the first accumulation signal, and the amplitude of the 

specific frequency component signal is normalized. The 
normalized specific frequency component signal for a 
second period of time longer than the first period of 
time, thereby generating a second accumulation signal. 

25 From the second accumulation signal, the watermark 

information is detected. As in the previous case, 
image rotation may be performed on the input image 



signal before the auto-correlation function is 
computed. 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 

FIG. 1 is a block diagram showing a digital 
watermark detection apparatus according to a first 
embodiment of the present invention; 

FIG. 2 is a chart for explaining phase shift of a 
specific frequency signal by a phase controller in the 
first embodiment; 

FIG. 3 is a graph showing an operation example of 
peak search for a cross-correlation value and watermark 
information detection in the digital watermark 
detection apparatus according to the first embodiment 
of the present invention; 

FIG. 4 is a block diagram showing a digital 
watermark detection apparatus according to a second 
embodiment of the present invention; 

FIG. 5 is a block diagram showing a digital 
watermark detection apparatus according to a third 
embodiment of the present invention; 

FIG. 6 is a block diagram showing an essential 
part of a digital watermark detection apparatus 
according to a fourth embodiment of the present 
invention; 

FIG. 7 is a block diagram showing an essential 
part of a digital watermark detection apparatus 
according to a fifth embodiment of the present 



invention; 

FIG. 8 is a block diagram showing an essential 
part of a digital watermark detection apparatus 
according to a sixth embodiment of the present 
invention; 

FIG. 9 is a view useful in explaining computation 
of correlation performed in an oblique direction to 
detect a digital watermark from an image subjected to 
rotational transform; 

FIG. 10 is a block diagram illustrating a first 
concrete example of a watermark estimation unit 
incorporated in the digital watermark detection 
apparatus ; 

FIG. 11 is a block diagram illustrating a second 
concrete example of the watermark estimation unit 
incorporated in the digital watermark detection 
apparatus; 

FIG. 12 is a block diagram illustrating a third 
concrete example of the watermark estimation unit 
incorporated in the digital watermark detection 
apparatus; 

FIG. 13 is a view illustrating a determination 
threshold value for watermark information detection, 
which are changed in accordance with an accumulation 
period of time; 

FIG. 14 is a view illustrating a general 
correlation operation; 



FIG. 15 is a view illustrating a correlation 
operation performed on every other pixel; 

FIG. 16 is a view illustrating a correlation 
operation performed on eight pixels contained in every 
other block; and 

FIG. 17 is a view illustrating a correlation 
operation performed on every other pixels contained in 
every other block. 

DETAILED DESCRIPTION OF THE INVENTION 

Embodiments of the invention will be described in 
detail with reference to the accompanying drawings. 

( First Embodiment ) 

A digital watermark detection apparatus according 
to a first embodiment of the invention receives, via a 
recording medium or transmission medium, an image 
signal having watermark information embedded therein, 
which is generated by a digital watermark embedding 
apparatus (not shown) corresponding to the digital 
watermark detection apparatus. 

This digital watermark embedding apparatus will 
now be described briefly. In the digital watermark 
embedding apparatus, a specific frequency signal 
extraction unit extracts, from an original image 
signal, a specific frequency component, for example, a 
relatively high frequency component. The specific 
frequency component signal is subjected to phase 
control, performed by a phase controller in accordance 
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with a specific phase control amount that is 
predetermined by digital watermark information to be 
embedded into an input image signal. The phase- 
controlled specific frequency component signal is 
5 supplied to a watermark information superposition unit 

formed of a digital adder, where it is superposed upon 
the original image signal. As a result, an image 
signal embedded with watermark information is 
generated. 

10 The thus-obtained image signal embedded with 

watermark information is recorded on a recording medium 
by, for example, a digital image recording/reproducing 
apparatus, such as a DVD, or transmitted via a 
transmission medium, such as the Internet, a 

15 broadcasting satellite, a communication satellite, etc. 

Such a digital watermark embedding apparatus as 
described above is disclosed in, for example, US Patent 
Application No. 10/327,072, the entire contents of 
which are incorporated herein by reference. 

20 Referring now to FIG. 1, an input image signal 10 

embedded with watermark information is supplied to the 
input of a specific frequency component extraction unit 
11 and the first input of a correlator 13. The 
specific frequency component extraction unit 11 

25 comprises a digital filter of the same frequency band 

as that of a specific frequency component extraction 
unit incorporated in the aforementioned digital 
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watermark embedding apparatus- More specifically, the 
unit 11 comprises an HPF (High Pass Filter) having a 
specific cutoff frequency, or a BPF (Band Pass Filter) 
having a passband center frequency. The specific 
5 frequency component extraction unit 11 extracts a 

specific frequency component, such as a relatively high 
frequency component, from the input image signal 10. 

The specific frequency component signal is 
subjected to phase control of a predetermined phase 

10 control amount by a phase controller 12, i.e., the 

signal is phase-shifted. The phase controller 12 is, 
for example, a digital phase shifter. In the phase 
shift example in FIG. 2 using the phase controller 12, 
the phase of the specific frequency component signal is 

15 shifted with its original waveform maintained. The 

amount of phase shift is controlled continuously or 
stepwise . 

The phase-controlled specific frequency component 
signal is supplied to the first input of the correlator 

20 13. The correlator 13 computes a cross-correlation 

value between the phase-controlled specific frequency 
component signal and the input image signal 10. The 
cross-correlation value is output from the correlator 
13 to a watermark information estimation unit 14. 

25 The watermark information estimation unit 14 

searches for a peak in the cross-correlation value 
(signal) , as shown in FIG. 3, thereby detecting 
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watermark information by estimation. In the cross- 
correlation value with respect to the phase shift 
amount of the phase controller 12, a peak appears at a 
certain phase-shift amount. The polarity of the peak 
5 indicates the presence of watermark information. If 

the input image signal 10 is under an attack of 
scaling, the phase shift amount of a specific frequency 
component contained in the input image signal 10 
differs from the amount of phase shift performed on the 

10 specific frequency component by the digital watermark 

embedding apparatus. 

In light of this, in the embodiment, the phase 
shift amount in the phase controller 12 is varied 
continuously or stepwise, thereby enabling the 

15 watermark information estimation unit 14 to search for 

peak in the cross-correlation value (signal) output 
from the correlator 13. Presence of watermark 
information is determined from the polarity of the peak 
that has been discovered. The peak in the cross- 

20 correlation value (signal) assumes a positive or 

negative polarity in accordance with the value between 
watermark information. In the example of FIG. 3, if 
the polarity of the peak is positive, it is determined 
that the watermark information assumes a value of "1", 

25 while if the polarity of the peak is negative, it is 

determined that the watermark information assumes a 
value of "0". Thus, the watermark information 
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estimation unit 14 outputs detected watermark 
information 15. 

As described above, in the first embodiment, a 
specific frequency component signal is extracted from 
5 an input image signal and subjected to phase control. 

The cross-correlation value between the phase- 
controlled specific frequency component signal and the 
input image signal is computed, whereby watermark 
information is detected from the cross-correlation 
10 value. Watermark information can be easily detected 

from an input image signal against which an attack of 
scaling was made, by searching for a peak in the cross- 
correlation value, while varying the amount of phase 
control . 

15 (Second Embodiment) 

Referring to FIG. 4, a digital watermark detection 
apparatus according to a second embodiment receives, 
via a recording medium or transmission medium, an image 
signal (input image signal 10) generated by a digital 

2 0 watermark embedding apparatus (not shown) , as in the 

first embodiment. The input image signal 10 is 
supplied to the input of the phase controller 12 and 
the first input of the correlator 13. The image signal 
subjected to phase control by the phase controller 12 

25 is supplied to the second input of the correction unit 

13, where a correlation operation is performed on the 
image signal and input image signal 10, thereby 
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computing an auto-correlation function. The auto- 
correlation function is input to a specific frequency 
component extraction unit 16. 

The specific frequency component extraction unit 
5 16 comprises an HPF or a BPF, as in the specific 

frequency component extraction unit 11 shown in FIG. 1, 
and extracts a specific frequency component by 
filtering the auto-correlation function. The extracted 
specific frequency component signal is input to a 

10 watermark information estimation unit 17, where the 

peak level of the extracted specific frequency 
component signal is searched for, and the polarity of 
the peak level is determined. 

The peak level of the extracted specific frequency 

15 component signal assumes a positive or negative 

polarity in accordance with the value of watermark 
information embedded in the input image signal 10. If 
the polarity of the peak level is positive, a watermark 
information estimation unit 17 estimates that the 

20 watermark information assumes a value of "1", while if 

the polarity of the peak level is negative, the unit 17 
estimates that the watermark information assumes a 
value of "0". Thus, the watermark information 
estimation unit 17 outputs detected watermark 

25 information 15. If phase control by the phase 

controller 12, a correlation operation by the 
correlator 13 and filtering by the specific frequency 
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component extraction unit 17 are linear operations, the 
digital watermark detection apparatus of the second 
embodiment is equivalent to that shown in FIG. 1. 

In the second embodiment, the auto-correlation 
5 function of an input image signal is computed and 

filtered to generate a specific frequency component 
signal. Watermark information can be easily detected 
from an input image signal against which an attack of 
scaling was made, by computing the auto-correlation 

10 function of the input image signal while varying the 

amount of phase control with respect to the input image 
signal, searching for the peak level of the specific 
frequency component signal, and determining the 
polarity of the peak level. 

15 (Third Embodiment) 

Referring to FIG. 5, a digital watermark detection 
apparatus according to a third embodiment will be 
described. The digital watermark detection apparatus 
of FIG. 5 receives, via a recording medium or 

20 transmission medium, an image signal (input image 

signal 10) generated by a digital watermark embedding 
apparatus (not shown) as in the first embodiment. The 
input image signal 10 is supplied to the input of the 
phase controller 12 and the first input of the 

25 correlator 13. The image signal subjected to phase 

control by the phase controller 12 is supplied to the 
second input of the correction unit 13, where a 
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correlation operation is performed on the image signal 
and input image signal 10, thereby computing an auto- 
correlation function. The process so far is similar to 
that employed in the second embodiment. 
5 In the third embodiment, the auto-correlation 

function from the correlator 13 is input to a first 
accumulator 20. The first accumulator 20 accumulates 
the auto-correlation function for a first short period 
of time corresponding to several lines, one field, 

10 several fields, one frame, or several frames, in which 

the characteristics of an image corresponding to the 
input image signal does not significantly change, 
thereby generating a first accumulation signal. The 
accumulator 20 is reset each time the first accumula- 

15 tion signal is generated, and resumes accumulation of 

the auto-correlation function. 

The first accumulation signal is input to a 
specific frequency component extraction unit 21, where 
it is filtered. As a result, a specific frequency 

20 component signal is extracted. The specific frequency 

component signal is input to a normalization unit 22. 
The normalization unit 22 normalizes the amplitude of 
the specific frequency component signal so that the 
characteristics of the image corresponding to the input 

25 image signal 10 do not influence the detection of 

watermark information. The normalized specific 
frequency component signal is input to a second 
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accumulator 23. 

The second accumulator 23 accumulates the 
normalized specific frequency component signal for a 
second period of time, thereby generating a second 
5 accumulation signal. The second period of time is 

set to, for example, 15 sec, 30 sec, or 1 min., which 
is longer than the first period of time as the 
accumulation period of the first accumulator 20. 
The accumulator 23 is reset each time the second 

10 accumulation signal is generated, and resumes 

accumulation of the normalized specific frequency 
component signal. The second accumulation signal is 
input to a watermark information estimation unit 24, 
where the peak level of the specific frequency 

15 component signal is searched for, and the polarity of 

the peak level of the second accumulation signal is 
determined, thereby detecting watermark information 15. 

In the third embodiment, the auto-correlation 
function of an input image signal is computed and 

20 accumulated, thereby extracting a specific frequency 

component signal. The specific frequency component 
signal is normalized in amplitude and accumulated, and 
watermark information is detected from the accumulated, 
normalized specific frequency component signal. The 

25 auto-correlation function of an input image signal is 

computed while varying the amount of phase control with 
respect to the input image signal, thereby searching 



for the peak level of a specific frequency component 
signal and determining the polarity of the peak level. 
By virtue of this process, watermark information can be 
easily detected from an input image signal against 
which an attack of scaling was made. In this 
embodiment, since the auto-correlation function is 
accumulated and filtered by the specific frequency 
component extraction unit 21, the number of filtering 
operations can be reduced, compared to the case where 
the cross-correlation value between an input image 
signal and a filtered image signal is accumulated. 
Accordingly, the cost required for detecting watermark 
information can be reduced without degrading the 
watermark information detection performance. 
(Fourth Embodiment) 

FIG. 6 shows an essential part of a digital 
watermark detection apparatus according to a fourth 
embodiment of the invention. This digital watermark 
detection apparatus incorporates an operation amount 
controller 25, in addition to the elements employed in 
the digital watermark detection apparatus of FIG. 5. 
In this embodiment, it is assumed that part or all of 
the processes of the digital watermark detection 
apparatus is realized by software processing, using a 
processor, such as a versatile or dedicated CPU 
(Central Processing Unit) , DSP (Digital Signal 
Processor), etc. The operation amount controller 25 
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acquires, from, for example, an OS (Operating System) , 
information 2 6 indicative of the throughput of the 
processor. "Throughput" means the original performance 
of the processor and/or the ever-changing performance 
5 of the processor. 

If the throughput of the processor is relatively 
low, the operation amount controller 25 controls the 
correlator 13 so as to reduce the operation amount of 
the unit 13 per unit time. Specifically, if the 
10 throughput is lower than a predetermined threshold 

value, the operation amount controller 25 periodically 
stops the operation of the correlator 13 in units of 
pixels, lines, fields or frames of the input image 
signal 10. 

15 If the operation amount of the correlator 13 is 

reduced, the accumulation amount of the specific 
frequency component signal at the second accumulator 23 
reduces. Accordingly, the watermark information 
detection performance degrades. To secure the 

20 accumulation amount, the operation amount controller 25 

controls the accumulation period (second period) of the 
accumulator 23. If, for example, the correlator 13 is 
stopped every two lines to perform a correlation 
operation every two lines, the operation amount per 

25 unit time is halved, accordingly the accumulation 

amount of the correlation value is halved. To secure 
the same accumulation amount as that obtained when the 
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operation amount of the correlator 13 is not 
controlled, the operation amount controller 25 doubles 
the accumulation period of the accumulator 23. 

This enables watermark information to be detected 
5 without applying an excessive load on the processor. 

Therefore, watermark information detection can be 
realized even if a low-performance processor is used, 
or the processor is also used for a process other than 
digital watermark detection, which would drop the 

10 processor throughput below the threshold value. 

Conversely, if the throughput of the processor is 
higher than required, the frequency of stopping the 
correlation operation can be reduced to increase the 
accumulation amount and enhance the performance of 

15 watermark information detection. 

(Fifth Embodiment) 

FIG . 7 shows an essential part of a digital 
watermark detection apparatus according to a fifth 
embodiment of the invention. In the fifth embodiment, 

20 to detect a digital watermark embedded in an image 

signal subjected to rotational transform, an image 
rotation unit 27 for rotating an image corresponding to 
the input image signal 10 is provided before the phase 
controller and correlator, which differs from the third 

25 embodiment. The image rotation unit 27 outputs an 

image signal corresponding to an image obtained by 
rotating, in accordance with rotation angle information 
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28, the image corresponding to the input image signal 
10. As a result, even if the input image signal 10 is 
under an attack of rotation, watermark information can 
be acquired therefrom. 
5 As shown in, for example, FIG. 8, the image 

rotation unit 27 comprises a line buffer 29 and read 
unit 30. The line buffer 29 reads and temporarily 
stores a plurality of line components of the input 
image signal 10. The line components contained in the 

10 image signal stored in the line buffer 29 are read by 

the read unit 30, with the reading start portions of 
the line components being shifted to one another in 
accordance with the rotation angle information 28. The 
read unit 30 sets a line shift amount corresponding to 

15 the rotation angle information 29. 

FIG. 9 shows the arrangement of image pixels 114 
corresponding to the input image signal 10. In the 
correlator incorporated in a usual digital watermark 
detection apparatus, a correlation operation is 

20 performed in a line direction indicated by reference 

numeral 111. On the other hand, in this embodiment, 
concerning an input image signal under an attack of 
rotation, the image rotation unit 27 shifts each line 
component input to the correlator 13 in units of 

25 predetermined numbers of pixels, as indicated by 

reference numeral 112. As a result, image signal 
components, which correspond to pixels 113 expressed by 
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black dots and arranged in an oblique direction as 
shown in FIG. 9, are sequentially input to the 
correlator 13, whereby a correlation operation is 
performed on the pixels in the oblique direction. 
5 If the amount of line shifting in the read unit 30 

according to the rotation angle information 28 is 
changed at a position corresponding to integral 
multiples of a predetermined number n (e.g., eight) of 
pixels, for example, at the position of the pixel 113 
10 in FIG. 8, image signal data in the line buffer 29 can 

be effectively accessed. Accordingly, even if the 
input image signal 10 is under an attack of high-speed 
rotation, digital watermark information can be 
detected. 

15 Since the rotational angle 9 of an image is as 

small as 0 (0^0), cos 0^1, sin 0 ^ tan 0^0, 
line shifting of an input image signal 10 under an 
attack of rotation input to the correlator 13, 
performed by the image rotation unit 2 7 shown in 

20 FIG. 8, enables watermark information to be detected 

from the input image signal without increasing the 
operation amount. 

As described above, in this embodiment, the line 
components of the input image signal 10 input to the 

25 correlator 13 are gradually shifted, thereby 

approximating the rotation of the image. In 
particular, if the image rotation unit 27 comprises the 
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line buffer 29 and read unit 30 as shown in FIG . 8, 
watermark information embedded in an input image signal 
under an attack of rotation can be detected simply by 
changing a read address in the read unit 30 to change 
5 the amount of line shifting. Therefore, increases in 

the operation amount, the memory bandwidth of the line 
buffer 29 and the entire circuit scale can be avoided. 
Furthermore, when the position at which the amount of 
line shifting is changed is made to correspond to the 
10 word width in the line buffer 29, the efficiency of 

memory access can be enhanced, therefore watermark 
information can be easily detected even if the input 
image signal 10 is under an attack of high-speed 
rotation . 

15 (Example 1 of Watermark Information Estimation 

Unit) 

Referring to FIG. 10, a description will be given 
of an example of the watermark information estimation 
unit 24 in the digital watermark detection apparatus of 
20 FIG. 5. In this example, the watermark information 

estimation unit 24 comprises a threshold-setting unit 
31, watermark detector 32 and watermark determination 
unit 33. 

The threshold-setting unit 31 acquires information 
25 indicative of a second period of time corresponding 

to the accumulation period of time of the second 
accumulator 23 shown in FIG. 5, thereby changing, based 
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on the accumulation period, the threshold value set in 
the watermark determination unit 33 for determining 
watermark information. Specifically, the longer the 
accumulation period, the lower the threshold value is 
5 set. The watermark detector 32 detects watermark 

information from a second accumulation signal (obtained 
by normalizing and accumulating the specific frequency 
component of an auto-correlation signal) output from 
the second accumulator 23, thereby providing the 
10 watermark determination unit 33 with the detected 

watermark information and level (the absolute value of 
the amplitude of the peak of the second accumulation 
signal) . 

The watermark determination unit 33 compares the 
15 level supplied from the watermark detector 32 with the 

threshold value set by the threshold-setting unit 31. 
If the level is not less than the threshold value, the 
watermark determination unit 33 determines that the 
watermark detector 32 has correctly detected watermark 
2 0 information, and outputs the detected watermark 

information. If, on the other hand, the level is less 
than the threshold value, the watermark determination 
unit 33 determines that no watermark information is 
embedded, and outputs a message "No Watermark" . As 
25 mentioned above, basically, the longer the accumulation 

period, the lower the threshold value. However, the 
threshold value may also be set higher. The watermark 



determination unit 33 may perform determination in 
units of predetermined periods (e.g., 15 sec, 30 sec, 
one minute, etc-) using a threshold value corresponding 
to the period, or may perform determination using a 
continuously varied threshold value. 

As described above, in the embodiment, when the 
accumulation period is set long, the threshold value 
for determining watermark information is lowered to 
increase the probability of detection of watermark 
information. Accordingly, the detection performance is 
enhanced without increasing the operation amount or 
circuit scale required for the detection of watermark 
information. 

(Example 2 of Watermark Information Estimation 

Unit) 

Referring to FIG. 12, a description will be given 
of another example of the watermark information 
estimation unit 24 in the digital watermark detection 
apparatus of FIG. 5. In this example, the watermark 
information estimation unit 24 comprises at least two 
watermark detectors 41A and 41B that employ different 
watermark detection manners, and watermark 
determination unit 42. The watermark detectors 41A and 
41B individually detect watermark information. The 
watermark determination unit 42 determines whether the 
detection results of the detectors 41A and 41B are 
identical to each other. 
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The watermark detector 41A receives a second 
accumulation signal output from the accumulator 23 and 
indicative of the normalized and accumulated specific 
frequency component of an auto-correlation signal, 
5 then detects watermark information from the second 

accumulation signal using a first detection manner, 
and supplies the detection result to the watermark 
determination unit 42. Similarly, the watermark 
detector 41B detects watermark information from the 

10 second accumulation signal using a second detection 

manner, and supplies the detection result to the 
watermark determination unit 42. The watermark 
determination unit 42 compares the watermark 
information items from the watermark detectors 41A 

15 and 41B. If they are identical, the watermark 

determination unit 42 determines that digital watermark 
has been detected, and outputs the detected watermark 
information. If they are not identical, the unit 42 
determines that no digital watermark is embedded, and 

20 outputs a message "No Watermark". 

If, for example, the watermark detector 41A has 
detected watermark information "A" using the first 
detection manner, and the watermark detector 41B has 
detected watermark information "A" using the second 

25 detection manner, the two detection results are 

identical and hence watermark information "A" is 
finally acquired as a detection result. On the other 
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hand, if watermark information items "B" and "C" are 
acquired by the first and second detection manners, 
respectively, the two detection results differ from 
each other and hence watermark information cannot be 
5 confirmed, with the result that it is determined that 

no watermark information is embedded. The same idea as 
that of this embodiment can be utilized when three or 
more detection manners are employed. 

As stated above, the embodiment employs comparison 
10 of watermark information items obtained using a 

plurality of detection manners, which enables accurate 
detection of watermark information and reduction of the 
probability of erroneous detection. 

(Example 3 of Watermark Information Estimation 

15 Unit) 

Referring to FIG. 13, a description will be given 
of a further example of the watermark information 
estimation unit 24. In this example, in addition to 
the second accumulator 23 shown in FIG. 5, a third 

20 accumulator 50 is provided before the watermark 

information estimation unit 24 for accumulating the 
normalized specific frequency component of an auto- 
correlation signal. Further, the watermark information 
estimation unit 24 comprises a watermark detector 51, 

25 watermark provisional detector 52, provisional 

detection determination unit 53 and watermark 
determination unit 54. 
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The second accumulator 23 accumulates a normalized 
specific frequency component signal for the second 
period of time, and supplies a second accumulation 
signal to the watermark detector 51. The watermark 
5 detector 51 detects watermark information, and supplies 

a detection result to the watermark determination 
unit 54. The third accumulator 50 accumulates the 
normalized specific frequency component signal for a 
third period of time that is 1/n (n: an integer higher 

10 than 1) of the second period, and outputs an accumula- 

tion signal to the watermark provisional detector 52. 

The watermark provisional detector 52 performs 
provisional detection of watermark information, and 
outputs a provisional detection result to the 

15 provisional detection determination unit 53. After the 

provisional detection determination unit 53 accumulates 
a number n of provisional detection results, and 
compares them, it supplies the watermark determination 
unit 54 with a determination result indicative of 

2 0 whether or not more than half of the number n of 

provisional detection results are identical to each 
other . 

If the watermark determination unit 54 receives, 
from the provisional determination unit 53, a 
25 determination result indicating that more than half of 

the number n of provisional detection results are 
identical, it determines that watermark information has 
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a result, it is determined that no watermark 
information is embedded. 

As described above, in the embodiment, temporal 
continuity of watermark information is estimated, which 
5 enables watermark information to be correctly detected, 

i.e., enables the probability of erroneous detection of 
watermark information to be reduced. 
(Re: Correlator) 

A detailed description will now be given of the 
10 correlator 13 incorporated in the above-described 

digital watermark detection apparatuses. In general, a 
correlation operation means to sum up the multiplica- 
tion results of corresponding pixel values contained in 
certain signals X (n) and Y(n). The cross-correlation 
15 value (correlation coefficient) C of the certain 

signals X (n) and Y(n) is given by the following 
equation (1) : 

1-1 

C = £ x(n) x Y(n) ( 1 } 

n = 0 

20 where 1 represents a signal length. In the case of 

auto-correlation, Y(n) = X(n). 

FIG. 14 is a view useful in explaining a general 
correlation operation. In this operation, multiplica- 
tion and addition are performed a number of times 

25 corresponding to the number of pixels, therefore a 

large number of operations are required. To reduce the 
number of operations, thinning of pixel values is 
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performed. For example, a block, on which multiplica- 
tion and addition are performed, and a block, on which 
these operations are not performed, are switched in 
units of numbers of pixels n, thereby reducing the 
5 operation amount (to, for example, 1/n of the 

conventional one) . As a result, the accuracy of a 
correlation coefficient is reduced, but is still 
sufficient for the detection of watermark information. 
Thus, the operation amount can be effectively reduced. 
10 Specifically, if multiplication and addition are 

performed concerning every other pixel as shown in 
FIG. 15, the correlation coefficient C is given by 

n _ ^fxtn) x Y(n) if n = even 
C " 2- 1 0 else K } 

n = 0 

15 The pixel, on which multiplication is performed, 

and the pixel, on which multiplication is not 
performed, are exchangeable. As a result, the number 
of operations is half that conventionally required. 

Alternatively, multiplication and addition may be 

20 performed for the first eight pixels, and not for the 

next eight pixels, as is shown in FIG. 16. If this 
operation is repeated, the correlation coefficient C is 
given by 

0 , r _ tVxOi) x Y(n) if n / 8 = even 

25 c " 2. i 0 else 1 ; 

n = (T 

Also in this case, the pixel, on which 
multiplication is performed, and the pixel, on which 
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multiplication is not performed, are exchangeable. 
As a result, the operation amount is half that 
conventionally required. 

Further, the operation may be modified as shown in 
FIG. 17 and as given by formulas (2) and (3), where 
multiplication and addition are performed concerning 
every other pixel of the first eight pixels, but not 
performed concerning the next eight pixels. In this 
case, the correlation coefficient C is given by the 
following formula (4), and the operation amount is 1/4 
of the conventional one. 



As described above, by performing the correlation 
operation with pixel values thinned, the operation 
amount and circuit scale required for it can be 
effectively reduced without degrading the detection 
performance of watermark information. 

Additional advantages and modifications will 
readily occur to those skilled in the art. Therefore, 
the invention in its broader aspects is not limited to 
the specific details and representative embodiments 
shown and described herein. Accordingly, various 
modifications may be made without departing from the 
spirit or scope of the general inventive concept as 
defined by the appended claims and their equivalents. 




n = 0 



X(n) x Y(n) 
0 



if n/8 = even & n = even 
else 



(4) 



